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This evaluation compared mean scores and proficiency levels on the 2016-2017 CIRCLE 
English and Spanish language, literacy, and mathematics assessments between students 
enrolled in Early Childhood Centers (EECs) with their School-based Program (SBP) peers. The 
evaluation helped to determine whether there were observable differences in academic 
achievement between the two groups. 


Key findings include: 

e Comparisons of CIRCLE mean scores and proficiency rates indicated that the majority of 
HISD prekindergarten students, regardless of Pre-K program type, met or surpassed 
proficiency benchmarks by the end-of-year (EOY), Wave 3 CIRCLE assessment. 

e Prekindergarten program type correlated with differences in total mean scores and 
proficiency rates, with children enrolled in ECCs tending to outperform peers in SBPs on 
most subtests. 

e When demographic indicators, such as economically disadvantaged status, were taken into 
account, these differences became more apparent, particularly among students tested in 
English. 


Further distribution of this report is at your discretion. Should you have any further questions, 
please contact me at 713-556-6700. 


AL CJS 
Attachment 


cc: Grenita Lathan 
Gabrielle Coleman 


HOUSTON INDEPENDENT SCHOOL DISTRICT 


RESEARCH 


Educational Program Report 


Ry NT , A IMO } r 


STUDENT rs S 
CHI LDHOOD 


OL-B/ 


AMS, 2016-2017 


Research and Accountability 


ANALY ZING DATA, MEASURING PERFORMANCE. 


HISD 


Houston Independent School District 
Hattie Mae White Educational Support Center 
4400 West 18th StreetHouston, Texas 77092-8501 


www.HoustonliSD.org 


It is the policy of the Houston Independent School 
District not to discriminate on the basis of age, color, 
handicap or disability, ancestry, national origin, 
marital status, race, religion, sex, veteran status, 
political affiliation, sexual orientation, gender identity 
and/or gender expression in its educational or 
employment programs and activities. 


2017 BOARD OF EDUCATION 


Wanda Adams 
President 


Diana Davila 
First Vice President 


Jolanda Jones 
Second Vice President 


Rhonda Skillern-Jones 
Secretary 


Anne Sung 
Assistant Secretary 


Anna Eastman 

Manuel Rodriguez, Jr. 
Michael L. Lunceford 
Holly Maria Flynn Vilaseca 


Richard A. Carranza 
Superintendent of Schools 


Carla Stevens 
Assistant Superintendent 
Department of Research and Accountability 


Jessica Brown, Ph.D. 
Research Specialist 


Venita R. Holmes, Dr.P.H. 
Research Manager 


COMPARISONS OF ACADEMIC ACHIEVEMENT AMONG 
PREKINDERGARTEN STUDENTS ENROLLED IN HISD EARLY 
CHILDHOOD CENTERS AND SCHOOL-BASED PROGRAMS, 
2016-2017 


Executive Summary 
Program Description 


In compliance with Texas Education Code § 29.153, the Houston Independent School District (HISD) has 
provided free prekindergarten classes for eligible Houston area four-year old students since the 1985-1986 
school year. Following the growing consensus among educators and scholars that early education 
programs are a vital resource in equipping children, especially those from disadvantaged backgrounds, for 
success in school, HISD has looked for ways to further expand, support and develop prekindergarten 
programs within the district. In 2015, the 84 Texas State Legislature enacted HB 4, which established 
additional state support for early education programs including authorization for the High Quality 
Prekindergarten Grant, a program which assists districts by providing funding for the implementation of 
new, and enhancement of existing, high quality prekindergarten programs. The grant program focuses on 
certain enhanced quality standards related to curriculum, teacher qualification, academic performance and 
family engagement. Monies are restricted for use by prekindergarten programs only, but may be used for 
a range of innovations including the procurement of supplies, materials or educational technologies for 
classrooms, teacher training and professional development, and family outreach offers, such as the Ready 
Rosie program, which helps parents learn to model the skills and competencies essential for school success 
in interactions with their own children. HB4 also added new prekindergarten reporting requirements for 
participating districts, with requisite data collection beginning during the most recent (2016-2017) school 
year. 


Currently, HISD offers full-day prekindergarten programs to all eligible students within its attendance 
boundaries. To be eligible for participation in a free prekindergarten program in HISD for the 2016-2017 
report year, a child must (1) be four years old on or before September 1; (2) live within the HISD attendance 
boundary; (3) have an updated immunization record in accordance to state policy for students; and (4) meet 
at least one of the following criteria: 


(a) Be homeless; 

(b) Be unable to speak or understand English; 

(c) Be economically disadvantaged; 

(d) Be the child of an active-duty member of the U.S. military or one who has been killed, injured, or 
missing in action while on duty; 

(e) Is or ever has been the conservatorship of the Department of Family and Protective Services 
following an adversary hearing held as provided by Section 262.201. Family code; or 

(f) Meet any eligibility criteria for Head Start, not only those who meet the low-income eligibility criteria 
for Head Start. 


Children who meet the above criteria are determined by the Texas Legislature to be the most at risk for 
school failure, and therefore need more assistance to become school ready by the time they reach 
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kindergarten. Additionally, HISD also offers prekindergarten classes on a tuition basis to children who do 
not meet the above eligibility requirements. If space is available at a given school, children can be enrolled 
into an HISD prekindergarten on a tuition basis only after all students eligible for free Pre-K have been 
accommodated. A campus can also enroll up to five three-year-old students after all eligible four-year old 
students have been enrolled and if space is available (HISD, 2016a). 


Once enrolled, children are placed into either an early childhood center (ECC) or a school-based program 
(SBP; early childhood center within a school). Home language surveys are also administered to children’s 
parents or guardians in order to place them in a linguistically-appropriate HISD prekindergarten classroom 
(i.e., Transitional Bilingual, English as a Second Language, English, or Dual Language). With the exception 
of Montessori schools within HISD, the district uses the Frog Street Pre-K (FSPK) curriculum. The Frog 
Street Pre-K curriculum focuses on the physical, social, emotional, cognitive, and language development 
of preschool-age children (Schiller, n.d.). The quality of implementation of education curriculum affects 
children’s future academic success. Presently, the HISD operates 155 campuses that provide instruction 
for young children (Houston Independent School District [HISD], 2016a). 


Overview 


Pursuant to the accountability requirements set down by Texas HB4 and the High Quality Prekindergarten 
Grant, this report describes how well HISD early childhood centers (ECC) and school-based programs 
(SBP) are preparing young children to be school ready. Specifically, this report compared the language, 
literacy, and mathematics mean scores and proficiency levels of prekindergarten students who were 
enrolled in ECCs to those of their peers enrolled in SBPs during the 2016-2017 school year. 


Academic proficiency was measured using scores from the CIRCLE Assessment (formerly known as C- 
PALLS+), a test battery developed by the Children’s Learning Institute (CLI) at the University of Texas’s 
McGovern Medical School. CIRCLE subtests measure skills in early language acquisition, literacy, 
mathematics, and social and emotional skills through interactive, classroom-based activities. During the 
2016-2017 school year, HISD prekindergarten students were administered a total of seventeen CIRCLE 
language, literacy and mathematics subtests across three testing waves, the first at the beginning of the 
school year (BOY; Wave 1), the second at the middle of the school year (MOY; Wave 2), and the final at 
the end of the school year (EOY; Wave 3). Since not all subtests are administered in all three testing 
waves, this report isolates data from fourteen English-language, and thirteen Spanish-language, tests of 
mathematics, literacy, and language arts administered during Wave 3 (EOY), so as to better measure the 
impact of Pre-K program type on student progress. 


Highlights 


e Comparisons of CIRCLE mean scores as well as proficiency rates indicate that majorities of HISD 
prekindergarten students, regardless of subtest and Pre-K program type, met or surpassed proficiency 
benchmarks by the end of year (EOY) Wave 3 CIRCLE assessments. 


e Prekindergarten program type was observed to correlate with differences in total mean scores, with 
children enrolled in early childhood centers (ECCs) tending to achieve higher total means than peers 


in school-based programs (SBPs) on most subtests. 


e Prekindergarten program type was also observed to correlate with differences in proficiency rates, with 
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children enrolled in ECCs tending to be more likely than students in SBPs to meet or exceed minimum 
score benchmarks on most subtests. When demographic indicators, such as economically 
disadvantaged (EDA) status, were taken into account, these differences became more apparent, 
particularly among students tested in English. 


e Differences in both mean scale scores and proficiency rates between ECC and SBP-enrolled students 
were larger among English-language test-takers than among students tested in Spanish. Moreover, 
students who took the CIRCLE assessment in Spanish generally performed better, with Spanish- 
language test-takers more likely to meet or exceed proficiency benchmarks across all subtests than 
those students tested in English. 


Recommendations 


e The Early Childhood Department may want to identify and monitor factors that impact the educational 
experiences of students once they enroll in HISD Pre-K programs to provide further insight as to why 
students enrolled in ECC-based programs tended to achieve higher proficiency in language, literacy, 
and mathematics across most subtests than did students in SBPs. 


e The Early Childhood Department may want to do further research aimed at determining why English- 
language test takers tend to show lower CIRCLE subtest proficiency rates when compared to Spanish- 
language test-takers. The Department may also want to identify factors that cause English-language 
test-takers to apparently derive more benefit from ECC-based programs compared both to peers in 
SBPs and to Spanish-language test-takers. 


e The Early Childhood and Research and Accountability departments should consider monitoring the 
academic growth and achievement gaps of students in the context of demographic characteristics and 
content area. 


e The Early Childhood Department may consider working with the Student Assessment Department, 
Special Education Department and/or Research and Accountability Department to identify and 
implement with fidelity an inclusive, monitored assessment to measure all children’s strengths, 
progress, and needs upon entering and exiting HISD prekindergarten programs. 


Introduction 


Researchers suggest that high-quality early childhood centers (ECC) promote students’ school readiness, 
enhance students’ cognitive development, and reduce the risk of students’ having reading and writing 
difficulties as they progress through school (See Butin & Woolums, 2009). School readiness refers to 
children being prepared to succeed in a structured learning setting (United Nations Children’s Fund 
[UNICEF], 2012). While school readiness is important for all children, it is especially important for vulnerable 
and disadvantaged populations, including “girls, children with disabilities, ethnic minorities, and those living 
in rural areas” (UNICEF, 2012, p. 9). Students from disadvantaged backgrounds gain the most benefits 
from early childhood programs when compared to their non-disadvantaged peers (Brooks-Gunn, 2003; 
Currie, 2000; Gormley, Gayer, Phillips, & Dawson, 2005; Magnuson, Ruhm, & Waldfogel, 2007). 
Researchers suggest students who attend prekindergarten have higher completion rates in high school and 
lower dropout rates than their disadvantaged peers who did not attend preschool (see Currie, 2000; 
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UNICEF, 2012). Review of the literature concurs that the beneficial effects of an early childhood education 
are typically larger for disadvantaged youth compared to their non-disadvantaged peers (Currie, 2000). 


The rising number of early childhood centers (ECCs) was in part attributed to the brain research highlighting 
the integral role early childhood education has in promoting the healthy development of children (Center on 
the Developing Child at Harvard University, 2010). HISD provided the following eight ECCs focused on 
serving young children (not to exceed second grade) during the 2016—2017 school year: Bellfort; Farias; 
Fonwood; Halpin; Martin Luther King, Jr.; Laurenzo; Mistral; and Neff. Early childhood centers within 
schools, hereafter referred to as school-based programs (SBP), were also offered at HISD bringing the total 
number of campuses that provide instruction to young children to 155 (HISD, 2016a). 


The purpose of this evaluation is to meet reporting requirements established by Texas HB4 and the High 
Quality Prekindergarten Grant, as well as to provide HISD and early childhood stakeholders with information 
about the academic achievement of HISD prekindergarten students who attended either an ECC or SBP 
during the 2016-2017 school year. This observational study answered the following research questions: 


1. How well do students perform in tests of language, literacy, and mathematics skills, as measured by 
the HISD CIRCLE assessment, by the end of one year of prekindergarten instruction? 


2. What were the differences in CIRCLE mean scores between HISD prekindergarten students who 
attended an early childhood center compared to students who enrolled in a school-based program 
during the 2016—2017 school year? 


3. What were the differences in CIRCLE proficiency rates between HISD prekindergarten students who 
attended an early childhood center compared to students who enrolled in a school-based program 
during the 2016-2017 school year? 


4. What were the differences in CIRCLE proficiency attainment and mean scores between HISD 
prekindergarten students when prekindergarten program type and demographic variables, such as 
economically disadvantaged (EDA) status, were taken into account? 


Methods 
Data Collection 


e Data collection for prekindergarten students who were enrolled in an HISD prekindergarten program 
during the 2016-2017 school year was conducted in two phases. The first phase of data collection 
identified all prekindergarten students (coded ‘PK’) who attended HISD during the 2016-2017 school 
year. This information, retrieved from the Public Education Information Management System (PEIMS) 
2016-2017 HISD student database, revealed that 14,664 Pre-K students attended HISD. 


e The second phase of data collection involved merging students’ PEIMS data to their academic data 
located in the HISD CIRCLE 2016-2017 student database. “The CIRCLE assessment is a revision of 
the Center for Improving the Readiness of Children for Learning and Education (CIRCLE) Phonological 
Awareness Language and Literacy System that now incorporates Science, Technology, Engineering 
and Math skills [((C-PALLS+STEM)]” (Landry, Assel, Williams, Zucker, Swank, & Gunnewig, 2014, p. 
2). 
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Sample 


e The PEIMS 2016-2017 HISD student database includes 14,664 prekindergarten students who had an 
Average Daily Attendance (ADA) eligibility classification greater than ‘0’-enrolled, no membership. After 
merging the PEIMS 2016—2017 HISD student database with the HISD CIRCLE 2016-2017 student 
database, and removing students who had either incomplete, no scores or had not achieved a minimum 
score greater than zero on the language, literacy, and mathematics subtests on the 2017 end-of-year 
(EOY) tests, the size of the sample evaluated in this report was reduced. Score totals for each subtest 
are listed in Appendices C, D, E and F-Tables 1 to 8 (pp. 23-49), however because some students 
may have been administered particular subtests more than once, and because some students may 
have been tested in both English and Spanish, these figures may render overestimates of actual counts 
of students tested. 


e Data retrieved from PEIMS represent a ‘snapshot’ of students who were enrolled by the last Friday in 
October of each school year in HISD (Texas Education Agency [TEA], 2016a). Students present for the 
‘snapshot’ may not have been actively enrolled in a specific HISD prekindergarten program the entire 
year. In contrast, students who were not present during the ‘snapshot’ may have actually enrolled later 
into a program, but were not identified as having attended either a SPB or ECC during the 2016-2017 
school year. Because these students were most likely not present for each assessment wave, they 
were not included in this report. 


Measures 


e The academic achievement of HISD prekindergarten students was measured on the CIRCLE 
assessment. CIRCLE is an online assessment tool designed to monitor the academic progress of 
prekindergarten children ages three years and six months to four years and eleven months. HISD 
currently uses this criterion-referenced assessment to determine children’s understanding in the areas 
of language, literacy, and mathematics. All CIRCLE assessments may be given in either English or 
Spanish with the exception of the Onset-Rime subtest, which is only administered in English (see 
Appendix C, Table 4, p. 26). The 2017 end-of-year (EOY) testing wave consisted of the following 
CIRCLE language and literacy subtests: ABC Names, ABC Sounds, Alliteration, Onset-Rime (English 
only), Rapid Vocabulary, Rhyming |, Syllabication, and Words in a Sentence. Mathematics subtests 
administered during the 2017 EOY testing wave included: Counting Sets, Number Naming, Operations, 
Patterns, Rote Counting, and Shape Naming. Appendix A (p. 21) shows the complete list of subtests 
HISD administered to students during the 2016—2017 school year. 


e English and Spanish versions of the CIRCLE assessment were administered three times a year to 
HISD prekindergarten students depending on their instructional program. Assessment “waves” 
occurred at the beginning-of-year (BOY; Wave 1), middle-of-year (MOY; Wave 2), and end-of-year 
(EOY; Wave 3). End of year (EOY) cut-point scores are provided in Table 1 (p. 6). If a student scored 
at or above the cut-point score determined for an academic domain, she or he was considered proficient 
in that area. If a student scored below the cut point, she or he was considered either ‘developing’ 
(referring to students younger than four years old) or ‘emerging’ (referring to students four years old 
and older), and therefore at academic risk (Landry et al., 2014). 
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Table 1. Cut-Point Scores on the HISD CIRCLE EOY Assessments by 


Subtest and Test Language 


Subtest: English Spanish 
Language and Literacy 

ABC Names 40 40 
ABC Sounds 40 40 
Rapid Vocabulary 22 16 
Syllabication 6 5 
Onset-Rime 3 Not tested 
Alliteration 6 5 
Rhyming | 7 5 
Words in a Sentence 4 3 
Subtest: English Spanish 
Mathematics 

Patterns 3 3 
Rote Counting 2 2 
Shape Naming 4 4 
Number Naming 3 3 
Counting Sets 4 4 
Operations 3 3 


Source. Adapted from Children’s Learning Institute (September 2016). C/RCLE Progress Monitoring Cut Points. University of Texas Children’s Learning 
Institute: Houston, TX. 
Note. If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scores below the 
benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students four years old and 
older). 


e The demographic characteristics of HISD prekindergarten students used for this report were collected 
from the PEIMS 2016-2017 HISD student database. Characteristics included gender, ethnicity, 
economically-disadvantaged status, special education eligibility status, limited English proficient (LEP) 
status, and at-risk status. HISD defines at-risk students as individuals who have an increased likelihood 
of dropping out of school. It is a composite measure based on the thirteen indicators shown in 
Appendix B (p. 22). 


Statistical Analyses 


e Summary statistics (i.e., count, mean, standard deviation, and percent) were computed to determine 
whether or not prekindergarten students were proficient in language, literacy, and mathematics by the 
end-of-year (EOY) on the HISD CIRCLE English and Spanish subtests. 


e Effect sizes were also computed to measure the magnitude HISD early childhood centers (ECC) had 
on students’ academic achievement when compared to students who attended a school-based program 
(SBP) using Hedge’s g. Hedge’s g is a standard deviation-based measure used to compute the effect 
size for different sample sizes. Hedge’s g follows similar criteria to Cohen’s d for determining the 
strength of an intervention with an effect size of 0.2 = small effect, 0.5 = moderate effect, and 0.8 = 
large effect. 
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e Data were not examined to determine if children participated in either an ECC or school-based program 
in years prior to 2016-2017. Thus, findings should be interpreted as the average impact of 
prekindergarten programs compared to each other (Zhai, Brooks-Gunn, & Waldfogel, 2011). 


Limitations 


e The information in this report was collected for HISD prekindergarten students identified as ‘PK’ only in 
the PEIMS 2016-2017 HISD student database. The population of students identified as receiving 
prekindergarten instruction may be an underestimate as HISD students coded as ‘EE’ during 2016-— 
2017 may have also received some Pre-K instruction. 


e Academic measures retrieved for prekindergarten students eligible for special education services may 
not truly reflect their 2016-2017 academic outcomes as a number of three and four-year-old students 
who attended ECCs and SBPs were coded as ‘EE’ during the 2016-2017 school year, and were 
therefore not included in the study sample. 


e The information in this report was primarily examined in the context of academic outcomes, 
demographic characteristics, and prekindergarten program type. Because no components of the 
prekindergarten programs were included in this report, variance explained by predictor variables in 
statistical models were limited. 


e The CIRCLE assessment was “not designed or evaluated for use for children with disabilities, e.g., 
language delays, [autism] spectrum disorders, or intellectual disabilities” (Landry et al., 2014, p. 4). As 
such, HISD currently does not have an inclusive assessment to monitor all children’s strengths, 
progress, and needs upon entering and exiting prekindergarten programs (National Association for the 
Education of Young Children & National Association of Early Childhood Specialists in State 
Departments of Education [NAEYC & NAECS/SDE], 2003). Caution should be exercised, therefore, 
when interpreting results in the context of special education status. 
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Results 


How well do students perform in tests of language, literacy, and mathematics skills, as measured 
by the HISD CIRCLE assessment, by the end of one year of prekindergarten instruction? 


Table 2. Academic Achievement of HISD Prekindergarten Students on the EOY HISD 
CIRCLE Assessment by Subtest and Testing Language, 2016—2017 


English Spanish 
Subtest type Subtest 
n Mean SD n Mean SD 
ABC Names 7,293 43.3 13.7 | 5,098 45.5 12.9 
ABC Sounds 7,000 40.4 14.2 | 4,993 44.2 13.5 
Alliteration 5,013 5.7 1.6 
Onset-Rime 6,669 4.0 1.3 N/A N/A N/A 
Language and 
Literacy Rapid Vocabulary 7,530 24.3 9.7 5,095 21.3 9.6 
Rhyming | 7,311 7.0 1.9 5,063 7.3 1.9 
Syllabication 4,993 6.1 1.5 
Wers hg 6,973 4.0 13 | 4,789 3.6 1.4 
Sentence 
Counting Sets 6,612 4.5 0.9 5,755 4.6 0.8 
Number Naming 6,342 3.9 1.2 5,483 4.0 1.2 
Operations 
Mathematics 
Patterns 6,109 3.4 0.9 5,659 3.4 0.9 
Rote Counting 
Shape Naming 6,668 4.5 0.9 5,775 4.4 1.0 


Source: HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note: If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scored below the 
benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students four years old and 
older). 

Note: Students who scored on average below the cut points are highlighted in gold. 


Table 2 shows descriptive statistics based on students’ mean scores on the 2016-2017 HISD CIRCLE 
assessment, broken down by test language version and subtest. Subtests for which the average mean 
score falls below the proficiency benchmark cut-off point (see Table 1, p. 6) are highlighted in gold. 


e The data show that HISD prekindergarten students’ average scores exceed proficiency benchmarks by 
the end-of-year (EOY) testing wave in all but four of fourteen subtests for English-language test-takers 
and two of thirteen for students who took the assessment in Spanish. 


e However, it is important to note that a score of two points is both the proficiency benchmark score and 
maximum possible score for the Rote Counting subtest, and a score of three points is both the 
maximum possible and proficiency score for the Operations subtest. Therefore, the “below proficiency” 
averages for these two subtests should be interpreted with caution as population means should be 
expected to fall below the proficiency benchmark for all groups but those with uniformly perfect scores. 
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What were the differences in CIRCLE mean scores between HISD prekindergarten students who 
attended an early childhood center compared to students who enrolled in a school-based program 
during the 2016-2017 school year? 


Table 3. Academic Achievement of HISD Prekindergarten Students on the EOY HISD CIRCLE English 


and Spanish Language and Literacy Assessments Based on Prekindergarten Program and Subtest 
Type, 2015-2016 


Early Childhood 


School-based 
Center (ECC) Program (SBP) 


Mean Effect 


Subtest type Subtest 


n Mean SD difference _—_ size 
ABC Names 1,097 44.4 13.0 | 6,196 43.1 13.9 1.3 0.09 
ABC Sounds 1,054 42.4 14.2 | 5,946 40.0 14.9 2.4 0.16 
Alliteration 0.4 0.25* 
English Onset-Rime 997 4.1 1.3 0.1 0.08 
Language and : a 
Literacy Rapid Vocabulary 1,105 269 9.8 3.0 0.31 
Rhyming | 1,069 7.4 1.8 0.4 0.21* 
Syllabication 1,071 6.2 1.4 0.3 0.18 
Worgs Ine 1,047 4.2 1.2 |5,926 4.0 1.3 0.2 0.16 
Sentence 
ABC Names 1112 45.9 13.0 0.5 0.04 
ABC Sounds 1,094 44.7 13.8 0.7 0.05 
Alliteration 1,079 5.8 1.6 0.1 0.07 
Spanish . 
Language and Rapid Vocabulary 1,110 21.1 8.8 -0.2 -0.02 
Literacy Rhyming | 1,084 7.4 1.9 0.1 0.05 
Syllabication 1,079 6.2 1.4 0.1 0.07 
aeTere Ue: 1,034 3.6 1.4 0.1 0.07 
Sentence 


Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scored below the 
benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students four years old and 
older). 

Note: Students who scored on average below the cut points are highlighted in gold. Assessments for which the Hedges g calculation exceeded the 
0.20 cutoff for small effect are italicized and marked with an asterisk. 


Table 3 shows descriptive statistics and effect size results based on students’ language and literacy 
achievement on the HISD CIRCLE English and Spanish assessments by prekindergarten program and 
subtest type. 


e Comparisons of cut-point scores (Table 1) and HISD CIRCLE English and Spanish language and 
literacy subtest results shown in Table 3 indicate that HISD students, on average, met or exceeded the 
proficiency standard on most assessments regardless of which type of prekindergarten program they 
attended. The only two exceptions to this were for the English Alliteration subtest, in which the average 
mean fell below the cut point for students in both early childhood center (ECC) and school-based (SBP) 
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programs, and for the English Syllabication subtest, in which only SBP students achieved an average 
below the cut point. 


e Data in Table 3 likewise show that pre-kindergarten students enrolled in ECCs tended to achieve 
comparable or higher mean scores across subtests than did their SBP-enrolled peers, with small effects 
(Hedges g 2 0.2) shown on the English-language Alliteration, Rapid Vocabulary, and Rhyming | 
subtests. 


e Appendices C (p. 23), D (p. 31), E (p. 38), and F (p. 44), Tables 1 - 8 show students’ detailed data on 
academic achievement by individual subtest, demographic characteristic, and age group. 


Table 4. Academic Achievement of HISD Prekindergarten Students on the EOY HISD CIRCLE English 
and Spanish Mathematics Assessments Based on Prekindergarten Program and Subtest 
Type, 2016-2017 


Early Childhood School-based 
Center (ECC) Program (SBP) 
Mean Effect 
Counting Sets 926 4.6 0.8 5,686 4.5 0.1 0.10 
Number Naming 894 4.2 1.1 5,448 3.9 0.3 0.25* 
English Operations 0.2 0.34* 
Mathematics Patterns 918 3.5 0.8 |5191 3.3 0.9 0.2 0.23* 
Rote Counting 0.1 0.29" 
Shape Naming 937 4.7 0.7 5,731 4.5 0.9 0.2 0.23" 
Counting Sets 1,257 4.6 0.9 4,498 4.7 0.8 -0.1 -0.12 
Number Naming 1,192 4.1 1.2 4,291 4.0 1.2 0.1 0.08 
Spanish Operations 0.0 0.00 
Mathematics Patterns 1,246 3.3 0.9 | 4,413 3.4 0.8 -0.1 -0.12 
Rote Counting 0.0 0.00 
Shape Naming 1,265 4.5 0.9 4,510 4.4 1.0 0.1 0.10 


Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scored below the 
benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students four years old and 
older). 

Note: Students who scored on average below the cut points are highlighted in gold. Assessments for which the Hedges g calculation 
exceeded the 0.20 cutoff for small effect are italicized and marked with an asterisk. 


Table 4 shows descriptive statistics and effect size results based on students’ mathematics achievement 
on the HISD CIRCLE English and Spanish assessments by prekindergarten program and subtest type. 


e Comparisons of cut-point scores (Table 1, p. 6) and HISD CIRCLE English and Spanish mathematics 
subtest results shown in Table 4 indicate that HISD students, on average, met or exceeded the 
proficiency standard on most assessments regardless of which type of prekindergarten program they 
attended. The only exceptions to this were for the Operations and Rote Counting subtests, in which 
the average mean for both the English and Spanish-language versions fell below the cut point for 
students in both program types—although as the proficiency cut point is the same as the maximum 
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possible score both subtests (See discussion on pg. 8), below-benchmark averages should be 
expected for these subtests in any population except one with uniformly perfect scores. 


e Data in Table 4 likewise show that pre-kindergarten students enrolled in ECCs tended to achieve 
comparable or higher mean scores across subtests than did their SBP-enrolled peers, with small 
effects (Hedges g 2 0.2) shown on five English-language subtests: Number Naming, Operations, 
Patterns, Rote Counting, and Shape Naming. 


e Appendices C (p. 23), D (p. 31), E (p. 38), and F (p. 44), Tables 1 - 8 show students’ detailed data on 
academic achievement by individual subtest, demographic characteristic, and age group. 


What were the differences in CIRCLE proficiency rates between HISD prekindergarten students who 
attended an early childhood center compared to students who enrolled in a school-based program 
during the 2016-2017 school year? 


Figure 1. Percent of HISD prekindergarten students who met the proficiency benchmark on the 
EOY CIRCLE English Language and Literacy Assessment by subtest and program type 


Words in a Sentence 
Syllabication 
Rhyming | 


Rapid Vocabulary 


Onset-Rime 
Alliteration 
ABC Sounds 
ABC Names 
0 20 40 60 80 100 
mSBP #ECC 


Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scores 
below the benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students 
four years old and older). 


e As Figure 1 indicates, more than 60 percent of HISD prekindergarten students, regardless of program 
type, met or exceeded the proficiency benchmark (see Table 1, p. 6) for all end-of-year (EOY) English 
CIRCLE language and literacy subtests. However, ECC-enrolled prekindergarten students were more 
likely to meet these benchmarks than were peers enrolled in school-based programs by an average 
difference of 9.7 percentage points. 
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Figure 2. Percent of HISD prekindergarten students who met the proficiency benchmark on the 
EOY CIRCLE Spanish Language and Literacy Assessment by subtest and program type 
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Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scores 
below the benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students 
four years old and older). 


e Figure 2 shows the percentage of HISD prekindergarten students who attained proficiency on the end- 
of-year (EOY) CIRCLE Spanish language and literacy assessments. As with the English language and 
literature assessments, a majority of students, regardless of Pre-K program type or subtest, met or 
exceeded this benchmark. 


e Acomparison with Figure 1 (p. 11) also shows that Spanish-language test takers, regardless of program 
type, were more likely to meet the proficiency benchmark than peers tested in English (with proficiency 
rates of greater than 76 percent for all subtests and Pre-K program types). 


e Finally, as with the English language and literacy assessments, students enrolled in ECCs were more 


likely to meet proficiency than were those enrolled in SBPs, though here the distinction was not as 
stark, with an average difference of 1.5 percentage points across all subtests. 
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Figure 3. Percent of HISD prekindergarten students who met the proficiency benchmark on the 
EOY CIRCLE English Mathematics Assessment by subtest and program type 


Shape Naming a 81.1 
Rote Counting on 84.6 
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Figure 4. Percent of HISD Prekindergarten Students who met the proficiency benchmark on the 
EOY CIRCLE Spanish Mathematics Assessment by subtest and program type 
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Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered proficient. If a student scores 
below the benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or ‘emerging’ (for students 
four years old and older). 


e CIRCLE English mathematics results illustrated in Figure 3 indicate that more than 70 percent of all 
prekindergarten students, regardless of program type, attained proficiency in this assessment by the 
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end of year (EOY) testing wave. However, students enrolled in early ECCs were more likely to meet 
or exceed the proficiency benchmark, by an average of 10.4 percentage points. 


e Figure 4 likewise shows proficiency rates of over 76 percent on the CIRCLE Spanish mathematics 
assessment, regardless of program type, although students enrolled in ECC programs had slightly 
higher overall proficiency rates (with the exception of Spanish-language Rote Counting, for which 
proficiency rates were 0.4 percentage points lower.) 


e As with Spanish language and literacy assessments, however, differences in achievement between 
ECC and SBP-enrolled students were not as large as they were for English language test-takers, 
averaging out to a 0.8 percentage point advantage for ECC-enrolled students across all subtests. 


What were the differences in CIRCLE proficiency attainment and mean scores between HISD 
prekindergarten students when prekindergarten program type and demographic variables, such as 
economically disadvantaged (EDA) status, were taken into account? 


Figure 5. Percent of economically disadvantaged HISD prekindergarten students who met the 
proficiency benchmark on the EOY CIRCLE English Language and Literacy Assessment 
by subtest and program type 
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Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered 
proficient. If a student scores below the benchmark, she or he is considered ‘developing’ (refers to students 
younger than four years old) or ‘emerging’ (for student four years old and older). 
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Economically disadvantaged (EDA) students represent a majority of the district’s total enrollment, with 76.5 
percent of all HISD students qualifying for free or reduced-price lunch services (Houston Independent 
School District [HISD], 2016d). Insofar as the exigent literature concurs that the beneficial effects of an 
early childhood education are typically larger for disadvantaged youth (Currie, 2000), and because EDA 
students are a key target demographic for HISD prekindergarten programs, the impact of Pre-K participation 
on this group is of particular interest. 


e Figure 5 shows the percent of EDA HISD prekindergarten students who met or exceeded the 
proficiency benchmark on the CIRCLE English language and literacy assessments by prekindergarten 
program and subtest. While majorities of all EDA students met the proficiency benchmark for each 
subtest (see Table 1, p. 6), students enrolled in early ECC-based programs showed an 11.4 percentage 
point difference in proficiency rates compared to peers enrolled in SBPs. 


Figure 6. Percent of economically disadvantaged HISD prekindergarten students who met the 
proficiency benchmark on the EOY CIRCLE Spanish Language and Literacy Assessment 
by subtest and program type 


Words ina 78.3 
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Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered 
proficient. If a student scores below the benchmark, she or he is considered ‘developing’ (refers to students 
younger than four years old) or ‘emerging’ (for student four years old and older). 


e Percentages of economically disadvantaged (EDA) students who met or exceeded proficiency 
benchmarks (see Table 1, p. 6) on the end-of year (EOY) CIRCLE Spanish language and literacy 
assessments are shown in Figure 6. While total proficiency rates exceed 70% for all Spanish-language 
test-takers (and generally exceed those of EDA English-language test-takers, as shown in Figure 5), 
students enrolled in ECC-based programs met or exceeded the proficiency benchmark across all 
subtests by an average of 3.7 percentage points when compared to students in SBPs. 
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Figure 7. Percent of economically disadvantaged HISD prekindergarten students who met the 
proficiency benchmark on the EOY CIRCLE English Mathematics Assessment by 
subtest and program type 
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Figure 8. Percent of economically disadvantaged HISD prekindergarten students who met the 
proficiency benchmark on the EOY CIRCLE Spanish Mathematics Assessment by 
subtest and program type 
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Source. HISD CIRCLE 2016-2017 student database; PEIMS 2016-2017 HISD student database. 

Note. If a student scores at or above cut points determined for a particular measure, she or he is considered 
proficient. If a student scores below the benchmark, she or he is considered ‘developing’ (refers to students younger than four years old) or 
‘emerging’ (for student four years old and older). 
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e Figure 7 shows proficiency attainment on the EOY CIRCLE English mathematics assessment by 
subtest and program type. Overall, more than 68 percent of economically disadvantaged (EDA) 
students met or exceeded the proficiency benchmarks on each subtest, regardless of program 
type. However, EDA students enrolled in ECCs demonstrated higher proficiency rates by an 
average of 12 percentage points. 


e Figure 8 compares proficiency rates on the EOY CIRCLE Spanish mathematics assessment. Pass 
rates exceed 75% for all EDA students, but here the effect of program type is less clear. EDA 
students enrolled in SBPs achieved higher proficiency rates in four subtests (Shape Naming, Rote 
Counting, Patterns, and Counting Sets) by an average of 0.6 percentage points over their ECC 
enrolled peers, while ECC-enrolled students performed better on two subtests (Operations and 
Number Naming) by an average of 1.5 percentage points. 


Information on mean score differences and hedges g effect size calculations by program status and subtest 
for other demographic indicators including race, gender, age-group, limited English proficient (LEP), special 
education, and at-risk status may be found in Appendices C (p. 23), D (p. 31), E (p. 38), and F (p. 44), 
Tables 1-8. This data indicate programmatic differences in mean scores for other demographic variables 
as well, the most consistent of which were small positive effects for ECC-enrolled black students tested in 
English. 


Discussion 


The prekindergarten program is a complex subsystem of early childhood education that is situated within 
the walls of an elementary school, charged with making and implementing decisions to promote the 
equitable development, learning, and school readiness of all children. Each child-whatever her or his 
abilities and differences- should be respected and taken into careful consideration in order for her or him to 
be included in prekindergarten to the fullest extent with the highest expectations (NAEYC, NAECS/SDE, 
2003). For this report, descriptive statistical analyses and effect size computations were used to examine 
total proficiency rates among HISD prekindergartners on the 2016-2017 end-of-year (EOY) CIRCLE 
assessments for language, literacy, and mathematics. Total CIRCLE proficiency rates and mean scores 
were also compared between prekindergartners enrolled in early childhood centers and those enrolled in 
school-based programs to see if differences in educational environment correlated with assessment 
outcomes. HISD early childhood centers include Bellfort; Farias; Fonwood; Halpin; Martin Luther King, Jr.; 
Laurenzo; Mistral; and Neff. 


Results from descriptive analyses indicated that majorities of HISD pre-schoolers attain proficiency in 
language, literacy, and mathematics by the EOY testing wave regardless of subtest, program type, or 
testing language. Students, particularly those tested in English, who were enrolled in ECC-based 
programs, tended to show higher mean scale scores and overall proficiency rates than did peers who 
matriculated in school-based programs. Among students tested in Spanish, these effects were smaller and 
more mixed. Students tested in Spanish also showed higher overall proficiency rates than those tested in 
English, although it is not clear to what extent this may be an artifact of content variation between test- 
language versions or differences in benchmark scores, rather than a result of programmatic differences. 


With respect to demographic characteristics, this report includes an examination of CIRCLE proficiency 
rates for students from economically-disadvantaged (EDA) backgrounds. Data show that, as with the total 
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prekindergarten population, majorities of EDA students attain proficiency by the end-of-year (EOY) testing 
wave regardless of subtest, testing language, or program type. However, EDA students enrolled in early 
childhood centers did lead their school-based program enrolled peers in total proficiency rates across all 
English-language subtests and all but three of thirteen Spanish-language ones. The impact of demographic 
characteristics on mean subtest scores are illustrated in Appendices C, D, E and F, Tables 1-8. These 
show persistent positive effects for ECC-enrollment for black students tested in English as well as more 
mixed and inconsistent effects (both positive and negative) with respect to other demographic indicators. 


Recommendations 


e The Early Childhood Department may want to identify and monitor factors that impact the educational 
experiences of students once they enroll in HISD Pre-K programs to provide further insight as to why 
students enrolled in ECC-based programs tended to achieve higher proficiency in language, literacy, 
and mathematics across most subtests than did students in SBPs. 


e The Early Childhood Department may want to do further research aimed at determining why English- 
language test takers tend to show lower CIRCLE subtest proficiency rates when compared to Spanish- 
language test-takers. The Department may also want to identify factors that cause English-language 
test-takers to apparently derive more benefit from ECC-based programs compared both to peers in 
SBPs and to Spanish-language test-takers. 


e The Early Childhood and Research and Accountability departments should consider monitoring the 
academic growth and achievement gaps of students in the context of demographic characteristics and 
content area. 


e The Early Childhood Department may consider working with the Student Assessment Department, 
Special Education Department and/or Research and Accountability Department to identify and 
implement with fidelity an inclusive, monitored assessment to measure all children’s strengths, 
progress, and needs upon entering and exiting HISD prekindergarten programs. 
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Appendix A 


HISD CIRCLE Subtests Administered to Students the 
2016-2017 School Year 


Wave 1 (BOY): September 25- October 13, 2016; Wave 2 (MOY): January 8- January 31, 2017; Wave 3 (EOY): May 
1-25, 2017 


Subtest A VEN (-tm i (310) 4) VEN (ewan (V0) 4] VEN (<u (0) 4) 
(olVict(e(-Me} me] ens 


Progress Monitoring Pre-K 


ABC Names (untimed) X X X 


ABC Sounds X Xx 


Subtest Inside of AV VEW(-ym it (3{0)'4) Wave 2 (MOY) VEN (<u (0) 4) 
CIRCLE Progress 


Monitoring Pre-K 


Rapid Vocabulary X X X 
Listening X 

Rhyming | X X X 
Alliteration X X X 
Words in a Sentence X X xX 
Syllabication X X X 
Onset-Rime X X X 
Only in English 

Rote Counting X X xX 
Shape Naming X X X 
Number Naming X X xX 
Counting Sets X X X 
Patterns X X X 
Operations X xX 
Positive Social Behaviors X X xX 
Early Writing Checklist X X X 
Book and Print Awareness X 


Adapted from the Houston Independent School District CIRCLE Assessment Required Subtests. 2016-2017 
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Appendix B 


AT-RISK-INDICATOR CODE: Definition 


AT-RISK-INDICATOR-CODE indicates whether a student is currently identified as at-risk of dropping 
out of school using state-defined criteria only (TEC 829.081, Compensatory and Accelerated 
Instruction). 

A student at-risk of dropping out of school includes each student who is under 26 years of age and who: 

1. isin prekindergarten, kindergarten or grade 1, 2, or 3 and did not perform satisfactorily on a 
readiness test or assessment instrument administered during the current school year; 

2. isin grade 7, 8, 9, 10, 11, or 12 and did not maintain an average equivalent to 70 on a scale of 100 
in two or more subjects in the foundation curriculum during a semester in the preceding or current 
school year or is not maintaining such an average in two or more subjects in the foundation 
curriculum in the current semester; 

3. was not advanced from one grade level to the next for one or more school years; (Note: From 
2010-2011 forward, TEC 29.081 (d-1) excludes from this criteria prekindergarten or kindergarten 
students who were not advanced to the next grade level as a result of a documented request by the 
student’s parent.) 

4. did not perform satisfactorily on an assessment instrument administered to the student under TEC 
Subchapter B, Chapter 39, and who has not in the previous or current school year subsequently 
performed on that instrument or another appropriate instrument at a level equal to at least 110 


percent of the level of satisfactory performance on that instrument; 


5. is pregnant or is a parent; 

6. has been placed in an alternative education program in accordance with TEC §37.006 during the 
preceding or current school year; 

7. has been expelled in accordance with TEC 837.007 during the preceding or current school year; 

8. is currently on parole, probation, deferred prosecution, or other conditional release; 

9. was previously reported through the Public Education Information Management System (PEIMS) to 


have dropped out of school; 


10. is a student of limited English proficiency, as defined by TEC 829.052; 

11. is in the custody or care of the Department of Protective and Regulatory Services or has, during the 
current school year, been referred to the department by a school official, officer of the juvenile 
court, or law enforcement official; 


12. is homeless, as defined NCLB, Title X, Part C, Section 725(2), the term “homeless children and 
youths”, and its subsequent amendments; or 

13. resided in the preceding school year or resides in the current school year in a residential placement 
facility in the district, including a detention facility, substance abuse treatment facility, emergency 
shelter, psychiatric hospital, halfway house, or foster group home. 


Special Instructions 
Please note that a student with a disability may be considered to be at-risk of dropping out of school if 
the student meets one or more of the statutory criteria for being in an at-risk situation that is not 


considered to be part of the student's disability. A student with a disability is not automatically coded as 
being in an at-risk situation. Districts should use the student's individualized education program (IEP) 
and other appropriate information to make the determination. 


Retrieved from the Texas Education Agency at http://tea.texas.gov/Reports and Data/Data_Submission/PEIMS/PEIMS Data _Standards/2015-2016 
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Academic Achievement on HISD CIRCLE English Language and Literacy Subtests 


Appendix C 


Table 1. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE ABC Names Subtest Based on Prekindergarten Program and 


School-based Program 


py-Viilelete-lelil ome] cele] omaty Kererd0) Wg 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Early Childhood Center 


n Mean SD Mean difference 

1,097 44.4 13.0 1.3 
3.5-4.0 yrs 200 33.0 18.3 2.8 
4.0+ 897 47.0 9.9 1.9 
Female 532 44.7 12.5 ial 
Male 565 44.2 13.5 1.6 
Asian 33 49.4 7.0 0.4 
Black 544 47.6 9.4 4.0 
Hispanic 483 40.3 15.6 -1.4 
Other 13 50.9 2.0 3.8 
White 24 46.8 10.9 1.4 
No 14 43.0 14.5 46.8 -3.8 
Yes 1,083 44.5 13.0 42.7 1.8 
No 1,048 44.6 12.9 6,012 43.2 13.7 1.4 
Yes 49 41.6 15.6 3.0 
No 995 44.4 13.0 1.3 
Yes 102 44.5 13.2 gS) 
No 335 48.0 10.7 1.1 
Yes 762 42.9 13.6 1.4 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Effect 
size 


0.09 


0.16 
0.16 


0.08 
0.11 
0.05 
0.31* 
-0.10 
0.36* 
0.12 
-0.34* 
0.13 
0.10 
0.18 
0.10 
0.11 
0.09 
0.10 


22 


Table 2. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE ABC Sounds Subtest Based on Prekindergarten Program and 


School-based Program 


Demographic Group, 2016-2017 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Early Childhood Center 


n Mean SD n Mean Mean difference 

1,054 42.4 14.2 5,946 40.0 2.4 
3.5-4.0 yrs 174 29.7 18.8 Zien 2.6 
4.0+ 880 44.9 11.5 41.9 3.0 
Female 512 42.4 14.2 40.8 1.6 
Male 542 42.4 14.2 3.2 
Asian 34 45.8 11.1 327 46.0 -0.2 
Black 533 45.0 9.4 2,179 40.3 4.7 
Hispanic -0.2 
Other 13 50.2 3.4 4.7 
White 23 45.1 12.0 2.6 
No 14 41.9 12.6 533 44.1 12.3 -2.2 
Yes 1,040 42.4 14.2 2.8 
No 1,010 42.5 13.9 5,791 40.2 14.8 2.3 
Yes 2.9 
No 956 42.3 14.3 4,742 40.0 2.3 
Yes 98 43.2 MSKS 1,204 40.2 3.0 
No 326 46.6 11.2 1,779 44.8 12.5 1.8 
Yes 728 40.5 14.9 25) 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpretina effect size measures for populations with sample sizes below n = 30. 
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Effect 
size 


0.16 


0.15 
0.15 


0.11 
0.21* 
-0.02 
0.33* 
-0.01 
0.47* 
0.20* 
-0.18 
0.19 
0.16 
0.16 
0.15 
0.20* 
0.15 
0.16 
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Table 3. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Alliteration Subtest Based on Prekindergarten Program and 
Demographic Group, 2016-2017 


Early Childhood Center School-based Program 
. ra . Effect 

Demographic characteristics n Mean SD Mean difference size 
Overall Sample 0.4 0.25* 

3.5-4.0 yrs 0.1 0.06 
Age Group 

4.0+ 0.4 0.27* 

Female 0.3 0.19 
Gender 

Male 0.3 0.19 

Asian -0.3 -0.20* 

Black 0.5 0.32* 
Ethnicity Hispanic 0.1 0.06 

Other 0.5 0.40* 

White -0.5 SOrson 

No -0.5 -0.36* 
Economically disadvantaged 

Yes 0.4 0.25* 

No 0.3 0.19 
Special Education eligible 

Yes -0.2 -0.11 

No 0.3 0.19 
Limited English Proficient (LEP) 

Yes 0.4 0.23" 

No 0.2 0.13 
At risk 

Yes 0.3 0.19 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 4. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Onset-Rime Subtest Based on Prekindergarten Program and 


Demographic Group, 2016-2017 
Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference ey 
Overall Sample 997 4.1 1.3 0.1 0.08 

3.5-4.0 yrs 151 3.2 1.4 0.1 0.07 
Age Group 

4.0+ 846 4.3 1.1 0.2 0.18 

Female 484 4.1 1.2 0.1 0.16 
Gender 

Male 513 41 1.3 0.2 0.15 

Asian 31 3.9 1.4 -0.4 -0.35* 

Black 503 4.3 1.2 0.3 0.23* 
Ethnicity Hispanic 429 3.8 1.3 0.0 0.00 

Other 13 4.8 0.4 0.3 0.32* 

White 21 39 1.1 -0.4 -0.36* 

No 12 3.8 1.41. -0.7 -0.70* 
Economically disadvantaged 

Yes 985 4.1 1.3 0.2 0.15 

No 951 41 1.3 0.1 0.08 
Special Education eligible 

Yes 46 31.9) 1.4 0.3 0.21* 

No 903 41 1.3 0.1 0.1 
Limited English Proficient (LEP) 

Yes 94 39 1.3 0.0 0.0 

No 310 4.4 172. 0.1 0.08 
At risk 

Yes 687 4.0 1.3 0.2 0.14 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 


HISD Research and Accountability 25 


Table 5. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Rapid Vocabulary Subtest Based on Prekindergarten Program and 


Demographic Group, 2016-2017 


Early Childhood Center School-based Program 


Demographic characteristics n Mean SD n Mean Mean difference ee 
Overall Sample 1,105 26.9 9.8 6,425 23.9 3.0 0.31* 
3.5-4.0 yrs 208 20.9 8.5 3.2 0.35* 
Age Group 
4.0+ 897 28.3 9.6 3.4 0.36* 
Female 537 Me 9.7 2.9 0.30* 
Gender 
Male 568 26.7 9.9 3.2 0.25* 
Asian -2.9 -0.34* 
Black 544 29.5 8.6 4.3 0.46* 
Ethnicity Hispanic 492 24.3 9.9 1.8 0.19 
Other 13 39.8 11.7 13.2 1.46* 
White 23 24.3 9.4 -1.6 -0.17 
No 13 23.0 8.6 -2.9 -0.33* 
Economically disadvantaged 
Yes 1,092 27.0 9.8 3.3 0.33* 
No 1,049 27.5 9.4 6,243 24.0 9.6 3.5 0.37* 
Special Education eligible 
Yes -2.4 -0.23* 
No 1,006 27.5 9.6 5,182 24.6 9.5 2.9 0.30* 
Limited English Proficient (LEP) 
Yes 0.1 0.01 
No 342 28.9 10.9 1,974 25.9 3.0 0.30* 
At risk 
Yes 763 26.0 9.1 4,451 23.0 3.0 0.32* 
Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut 
points are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 6. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Rhyming | Subtest Based on Prekindergarten Program and 


Demographic Group, 2016-2017 
Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference pity 
Overall Sample 1,069 7.4 1.8 0.4 0.21* 

3.5-4.0 yrs 185 5.8 2.1 0.2 0.10 
Age Group 

4.0+ 884 it 1.6 0.5 0.28* 

Female 524 7.5 1.8 0.4 0.21* 
Gender 

Male 545 7.3 1.8 0.4 0.20* 

Asian 33 7.2 1.9 0.2 -0.11 

Black 538 7.8 1.6 0.7 0.38* 
Ethnicity Hispanic 0.2 0.10 

Other 13 8.5 0.8 0.6 0.42* 

White 23 7.1 1.6 -0.5 -0.29* 

No -0.9 -0.52* 
Economically disadvantaged SS SSS SSS 

Yes 1,056 7.4 1.8 0.5 0.27* 

No 1,026 7.5 1.8 6,092 7.0 1.9 0.5 0.27* 
Special Education eligible 

Yes 0.2 0.10 

No 973 7.4 1.8 5,039 7.0 1.9 0.4 0.21* 
Limited English Proficient (LEP) 

Yes 96 7.2 il 7 0.4 0.20* 

No 333 7.8 17 1,918 7.3 1.9 0.5 0.27* 
At risk 

Yes 736 7.2 1.9 0.4 0.21* 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 7. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Syllabication Subtest Based on Prekindergarten Program and 


Demographic Group, 2016-2017 


Early Childhood Center 


Demographic characteristics n Mean SD 
Overall Sample 1,071 6.2 1.4 
3.5-4.0 yrs 189 5.2 Bail 
Age Group 
4.0+ 882 6.5 
Female 524 6.3 
Gender 
Male 547 6.2 
Asian 31 6.1 
Black 539 6.6 
Ethnicity Hispanic 
Other 13 6.9 
White 21 6.3 
No 12 
Economically disadvantaged 
Yes 1,059 
No 1,025 
Special Education eligible 
No 977 
Limited English Proficient (LEP) 
Yes 94 
No 333 
At risk 
Yes 738 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


School-based Program 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Mean difference 


0.3 


0.7 
0.4 


0.4 
0.4 
-0.1 
0.7 
0.1 
0.5 
0.1 
-0.2 
0.3 
0.4 
-0.3 
0.4 
0.2 
0.3 
0.4 


Effect 
size 


0.18 
0.35* 
0.28* 
0.25* 
0.24* 
-0.07 
0.44* 
0.06 
0.45* 
0.07 
-0.14 
0.18 
0.25* 
-0.15 
0.24* 
0.13 
0.19 
0.24* 
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Table 8. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Words in a Sentence Subtest Based on Prekindergarten Program 


School-based Program 


late M PY-Wuitelele-Volal(emei coll] omm-Ath RomeyAth Wg 


Early Childhood Center 


Demographic characteristics n Mean SD Mean difference 
Overall Sample 1,047 4.2 1.2 0.2 

3.5-4.0 yrs 176 3.5 1.5 0.4 
Age Group 

4.0+ 871 4.3 1.1 0.2 

Female 513 4.2 1.2 0.2 
Gender 

Male 4.1 0.1 

Asian -0.5 

Black 0.4 
Ethnicity Hispanic 0.0 

Other 0.4 

White -0.4 

No -0.5 
Economically disadvantaged 

Yes 0.2 

No 1,005 4.2 1.1 5,793 4.0 13 0.2 
Special Education eligible 

Yes -0.4 

No 954 4.2 1.2 4,768 4.0 13 0.2 
Limited English Proficient (LEP) 

Yes -0.1 

No 327 45 1.0 1818 4.2 1.2 0.3 
At risk 

Yes 720 4.0 1.2 0.1 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Effect 
size 


0.16 


0.27* 
0.17 


0.16 
0.08 
-0.44* 
0.32" 
0.00 
0.42" 
-0.39* 
-0.49* 
0.16 
0.16 
27" 
0.16 
-0.08 
0.26* 
0.08 
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Appendix D 


Academic Achievement on HISD CIRCLE Spanish Language and Literacy Subtests 


Table 1. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE ABC Names Spanish Language Subtest Based on Prekindergarten 


Program and Demographic Group, 2016-2017 


Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference pie 
Overall Sample 1,112 45.9 13.0 0.5 0.04 

3.5-4.0 yrs 208 32.7 17.3 0.9 0.05 
Age Group 

4.0+ 904 49.0 9.5 2.3 0.21* 

Female 580 45.5 13.3 -0.2 -0.02 
Gender 

Male 532 46.3 12.7 1.2 0.09 

Asian - - - 0.0 * 

Black 3 id * * % 
Ethnicity Hispanic 1,101 45.9 13.0 0.5 0.04 

Other 4 * * * * 

White 4 % x * * 

No 76 47.4 11.3 2.8 0.21* 
Economically disadvantaged 

Yes 1,036 45.8 13.1 0.4 0.03 

No 1,098 45.8 13.1 0.4 0.03 
Special Education eligible 

Yes 14 50.1 8.9 tate 0.50* 

No 34 44.8 13.5 1.8 0.13 
Limited English Proficient (LEP) 

Yes 1078 45.9 13.0 0.3 0.02 

No -6.6 -0.44* 
At risk 

Yes 1,106 45.9 13.0 0.5 0.04 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 2. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE ABC Sounds Spanish Language Subtest Based on Prekindergarten 


Program and Demographic Group, 2016-2017 
Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference pi 
Overall Sample 1,094 44.7 13.8 0.7 0.05 

3.5-4.0 yrs 202 31.3 18.4 3.8 0.21* 
Age Group 

4.0+ 892 47.7 10.3 2.2 0.19 

Female 573 44.0 14.3 -0.5 -0.04 
Gender 

Male 521 45.4 13.1 1.9 0.14 

Asian - - - - x 

Black 3 bs = a * 
Ethnicity Hispanic 1,083 44.7 13.8 0.7 0.05 

Other 4 a e si ze 

White 4 a * * a 

No 76 46.9 11.6 2.6 0.19 
Economically disadvantaged 

Yes 1,018 44.5 14.0 0.5 0.04 

No 1,080 44.7 13.8 0.6 0.04 
Special Education eligible 

Yes 14 44.0 15.4 3.5 0.22* 

No 32 45.8 13.2 3.4 0.24* 
Limited English Proficient (LEP) 

Yes 1062 44.7 13.8 0.6 0.04 

No 4 * * * * 
At risk 

Yes 1090 44.7 13.8 0.7 0.05 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 3. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Alliteration Spanish Subtest Based on Prekindergarten Program 


School-based Program 


Flare PY-vuatorele-lelal(emi coll] omwath Romeyt) Wg 


Early Childhood Center 


Demographic characteristics n Mean SD Mean difference 
Overall Sample 1,097 5.8 1.6 0.1 

3.5-4.0 yrs 193 4.4 1.9 0.1 
Age Group 

4.0+ 886 6.1 1.3 0.3 

Female 565 5.7 1.7 0.0 
Gender 

Male 514 5.8 1.5 0.2 

Asian - - - is 

Black 1 bs * * 
Ethnicity Hispanic 1,070 5.8 1.6 0.1 

Other 4 * : * 

White 4 me * 

No 75 6.2 1.3 0.6 
Economically disadvantaged 

Yes 1,004 5.7 1.6 0.0 

No 1,068 5.8 1.6 0.1 
Special Education eligible 

Yes 11 5.6 1.8 0.5 

No 22 6.0 1.6 0.3 
Limited English Proficient (LEP) 

Yes 1,057 5.8 1.6 0.1 

No 6 6.0 1.3 0.2 
At risk 

Yes 1,073 5.8 1.6 0.1 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 


Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 4. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Rapid Vocabulary Spanish-Language Subtest Based on 


Prekindergarten Program and Demographic Group, 2016-2017 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


Early Childhood Center 


School-based Program 


n Mean SD Mean difference 

1,110 21.1 8.8 -0.2 
3.5-4.0 yrs 207 16.6 8.7 -0.8 
4.0+ 893 22.2 8.5 0.5 
Female 574 21.4 8.8 0.0 
Male 526 20.8 8.8 -0.4 
Asian - - - - 
Black 1 bs * * 
Hispanic 1,091 21.2 8.8 -0.3 
Other 4 % = * 
White 4 a % * 
No 76 24.6 10.2 4.8 
Yes 1,024 20.9 8.6 -0.5 
No 1,086 21.2 8.8 -0.1 
Yes 14 17.0 8.6 -4.0 
No 22 18.4 8.9 2.3 
Yes 1,078 21.2 8.8 -0.5 
No 6 16.5 5.4 -2.9 
Yes 1,094 21.2 8.8 -0.1 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 5. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Rhyming | Spanish-Language Subtest Based on Prekindergarten 


Program and Demographic Group, 2016-2017 
Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference a 
Overall Sample 1,084 7.4 1.9 0.1 0.05 

3.5-4.0 yrs 196 5.6 2.2 -0.2 -0.09 
Age Group 

4.0+ 888 7.8 1.6 0.4 0.23* 

Female 569 7.3 2.0 0.0 0.00 
Gender 

Male 515 7.4 1.8 0.2 0.11 

Asian - - - is * 

Black 1 7 * * . 
Ethnicity Hispanic 1,076 7.4 1.9 0.1 0.05 

Other 3 * * * 

White 4 S x * * 

No 76 7.7 1.8 0.3 0.17 
Economically disadvantaged 

Yes 1,008 7.3 1.9 0.0 0.00 

No 1,074 7.4 1.9 0.1 0.05 
Special Education eligible 

Yes 10 7.3 2.1 0.5 0.27* 

No 22 7.6 1.7 0.5 0.26* 
Limited English Proficient (LEP) 

Yes 1,062 7.4 iG) 0.1 0.05 

No 6 6.8 1.7 -0.7 -0.43* 
At risk 

Yes 1,078 7.4 1.9 0.1 0.05 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 6. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Syllabication Spanish-Language Subtest Based on Prekindergarten 


Program and Demographic Group, 2016-2017 
Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference pen 
Overall Sample 1,079 6.2 1.4 0.1 0.07 

3.5-4.0 yrs 190 4.8 iL.@) -0.2 -0.11 
Age Group 

4.0+ 889 6.5 1.1 0.3 0.22* 

Female 565 6.1 1.5 0.0 0.00 
Gender 

Male 514 6.3 1.3 0.3 0.21* 

Asian - - - - * 

Black 1 * * * . 
Ethnicity Hispanic 1,070 6.2 14 0.1 0.07 

Other 4 * - * * 

White 4 a * * 

No 76 6.3 1.3 0.2 0.14 
Economically disadvantaged 

Yes 1,003 6.2 1.4 0.1 0.07 

No 1,068 6.2 1.4 0.1 0.07 
Special Education eligible 

Yes 11 6.2 1.5 0.7 0.41* 

No 21 6.2 1.4 0.0 0.00 
Limited English Proficient (LEP) 

Yes 1,058 6.2 1.4 0.1 0.07 

No 5 6.0 1.7 -0.2 -0.14 
At risk 

Yes 1,074 6.2 1.4 0.1 0.07 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 7. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Words in a Sentence Spanish-Language Subtest Based on 


Prekindergarten Program and Demographic Group, 2016-2017 


Early Childhood Center 


School-based Program 


Demographic characteristics n Mean SD Mean difference 
Overall Sample 1,034 3.6 1.4 0.1 

3.5-4.0 yrs 162 2.4 1.4 -0.4 
Age Group 

4.0+ 872 3.9 1.2 0.3 

Female 540 3.6 1.4 0.0 
Gender 

Male 494 3.7 1.3 0.2 

Asian - - - is 

Black 1 ° * * 
Ethnicity Hispanic 1,026 3.6 1.4 0.1 

Other 3 *. . * 

White 4 a * 

No 74 3.9 1.3 0.3 
Economically disadvantaged 

Yes 960 3.6 1.4 0.1 

No 1,024 3.6 1.4 0.0 
Special Education eligible 

-0.3 

No 21 3.4 1.4 0.0 
Limited English Proficient (LEP) 

Yes 1,013 3.6 1.4 0.1 

No 5 3.2 1:1 -0.7 
At risk 

Yes 1,029 3.6 1.4 0.1 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut 
points are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
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Appendix E 


Academic Achievement on HISD CIRCLE English Mathematics Subtests 


Table 1. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Counting Sets Subtest Based on Prekindergarten Program and 


py-Viilelele-lelil(ome] cele) omati Kererd0) Wg 


Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference pit 
Overall Sample 926 4.6 0.8 0.1 0.10 

3.5-4.0 yrs 146 41 iL 2 0.3 0.25* 
Age Group 

4.0+ 780 4.8 0.6 0.2 0.15 

Female 440 4.7 0.7 0.2 0.23* 
Gender 

Male 486 4.6 0.9 0.2 0.20* 

Asian 33 4.6 0.9 -0.2 -0.36* 

Black 526 4.8 0.7 0.3 0.35* 
Ethnicity Hispanic 334 4.4 0.9 0.0 0.00 

Other 12 4.9 0.3 0.1 0.15 

White 21 4.7 0.8 0.1 0.11 

No 13 4.2 1.1 -0.5 -0.62* 
Economically disadvantaged 

Yes 913 4.7 0.8 0.2 0.21* 

No 877 4.7 0.8 0.2 0.23* 
Special Education eligible 

Yes 49 4.0 1.2 0.0 0.00 

No 830 4.6 0.8 0.1 0.11 
Limited English Proficient (LEP) 

Yes 96 4.7 Ont 0.3 0.31* 

No 303 4.8 0.6 0.2 0.31* 
At risk 

Yes 623 4.6 0.9 0.2 0.20* 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 2. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Number Naming Subtest Based on Prekindergarten Program and 


School-based Program 


py Vriteyeteelilemei cele] omth Koped0) Wg 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 


Early Childhood Center 


n Mean SD Mean difference 

894 4.2 1.1 0.3 
3.5-4.0 yrs 128 3.4 1.3 0.5 
4.0+ 766 4.3 1.0 0.3 
Female 425 4.1 1.1 0.2 
Male 469 4.2 14 0.3 
Asian 32 4.4 1.0 -0.1 
Black 518 4.3 1.0 0.4 
Hispanic 312 3.9 1.2 0.2 
Other 12 4.1 0.8 -0.3 
White 20 4.0 0.8 -0.2 
No 12 4.1 1.4 -0.3 
Yes 882 4.2 1.1 0.4 
No 847 4.2 1.1 0.3 
Yes 47 3.8 1.3 0.1 
No 803 4.2 1.1 0.3 
Yes 91 4.2 1.1 0.2 
No 296 4.5 0.9 0.3 
Yes 598 4.0 dll 0.3 


Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Effect 
size 


0.25* 
0.38* 
0.26* 
0.17 
0.24* 
-0.11* 
0.34* 
0.16 
-0.30* 
-0.18 
-0.30* 
0.31* 
0.25* 
0.08 
0.25* 
0.16 
0.28* 
0.23" 
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Table 3. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Operations Subtest Based on Prekindergarten Program and 
pY-Viilelere-lelil(ome] cele] omaty Korerd0) Wg 


Early Childhood Center School-based Program 
3 ae : Effect 

Demographic characteristics n Mean SD Mean difference size 
Overall Sample 0.2 0.34* 

3.5-4.0 yrs 0.0 0.00 
Age Group 

4.0+ 0.1 0.15 

Female 0.2 0.34* 
Gender 

Male 0.1 0.15 

Asian 0.1 0.17 

Black 0.2 0.34* 
Ethnicity Hispanic 0.1 0.15 

Other 0.2 0.42* 

White -0.4 -0.65* 

No 0.1 0.17 
Economically disadvantaged 

Yes 0.2 0.30* 

No 0.2 0.34* 
Special Education eligible 

Yes 0.1 0.12 

No 0.2 0.34* 
Limited English Proficient (LEP) 

Yes 0.0 0.00 

No 0.2 0.35* 
At risk 

Yes 0.1 0.15 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 

Note: Insofar as a score of three (3) is both the proficiency benchmark and the maximum score for this subtest, total means for all groups but those with uniformly perfect scores will fall below 
it. 
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Table 4. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Patterns Subtest Based on Prekindergarten Program and 


py-Viilelete-lelil ome] cele] omaty Korerd0y Wg 
Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference ay 
Overall Sample 918 3.5 0.8 0.2 0.23* 

3.5-4.0 yrs 142 2.8 1.0 -0.1 0.09 
Age Group 

4.0+ 776 3.6 0.7 0.2 0.25* 

Female 434 3.5 0.8 0.1 0.11 
Gender 

Male 484 3.5 0.8 0.2 0.23* 

Asian 33 3.5 0.8 -0.2 -0.28* 

Black 520 3.6 0.7 0.3 0.35* 
Ethnicity Hispanic 333 3.4 0.9 0.1 0.11 

Other 12 3.9 0.3 0.3 0.45* 

White 20 3.6 0.6 0.1 0.13 

No 13 3.3 0.8 -0.3 -0.43* 
Economically disadvantaged 

Yes 905 3.5 0.8 0.2 0.23* 

No 868 3.5 0.8 0.2 0.23* 
Special Education eligible 

Yes 50 3.1 0.9 0.3 0.19 

No 827 3.5 0.8 0.2 0.23* 
Limited English Proficient (LEP) 

Yes 91 3.5 0.7 0.2 0.23* 

No 302 3.6 0.8 0.1 0.13 
At risk 

Yes 616 3.5 0.8 0.2 0.23* 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 5. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Rote Counting Subtest Based on Prekindergarten Program and 


Demographic Group, 2016-2017 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Early Childhood Center School-based Program 


3.5-4.0 yrs 
4.0+ 


Female 
Male 
Asian 
Black 
Hispanic 
Other 
White 
No 

Yes 

No 

Yes 

No 

Yes 

No 


Yes 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 


Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
Note: Insofar as a score of two (2) is both the proficiency benchmark and the maximum score for this subtest, total means for all groups but those with uniformly perfect scores will fall below it. 
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Mean difference 


0.1 


0.1 
0.0 


0.1 
0.1 
0.0 
0.1 
0.0 
0.1 
0.0 
-0.2 
0.1 
0.1 
0.0 
0.1 
0.1 
0.0 
0.1 


Effect 
size 


0.29* 


0.20* 
0.00 


0.26* 
0.26* 
0.00 
0.26* 
0.00 
0.35* 
0.00 
-0.65* 
0.26* 
0.26* 
0.00 
0.26* 
0.25* 
0.00 
0.26* 
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Table 6. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Shape Naming Subtest Based on Prekindergarten Program and 


School-based Program 


Demographic Group, 2016-2017 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 

Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Early Childhood Center 


n Mean SD Mean difference 

937 4.7 0.7 0.2 
3.5-4.0 yrs 152 4.3 1.0 0.3 
4.0+ 785 48 0.6 0.2 
Female 445 4.7 0.7 0.2 
Male 492 4.7 0.7 0.2 
Asian 33 4.9 0.4 0.1 
Black 528 4.8 0.5 0.3 
Hispanic 343 4.5 0.9 0.1 
Other 12 5.0 0.0 0.2 
White 21 4.8 OR 0.1 
No 13 4.9 0.4 0.2 
Yes 924 4.7 0.7 0.2 
No 883 4.7 0.7 0.2 
Yes 54 4.2 1.3 -0.1 
No 840 4.7 0.7 0.2 
Yes Ci 4.7 0.7 0.2 
No 306 48 0.7 0.1 
Yes 631 4.7 0.3 0.3 


Effect 
size 


0.23* 
0.26* 
0.26* 
0.23* 
0.23* 
0.15 
0.36* 
0.10 
0.30* 
0.14 
0.29* 
0.19 
0.23* 
-0.08 
0.23* 
0.19 
0.13 
0.32* 
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Appendix F 


Academic Achievement on HISD CIRCLE Spanish Mathematics Subtests 


Table 1. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Counting Sets Spanish Language Subtest Based on 
Prekindergarten Program and Demographic Group, 2016-2017 


Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference 
Overall Sample 1,257 4.6 0.9 -0.1 

3.5-4.0 yrs 256 4.0 1.2 -0.1 
Age Group 

4.0+ 1,001 4.7 0.7 0.0 

Female 663 4.6 0.9 -0.1 
Gender 

Male 594 4.6 0.9 0.0 

Asian - - - * 

Black 15 4.3 1.3 -0.3 
Ethnicity Hispanic 1,231 4.6 0.9 -0.1 

Other 5 4.2 0.5 -0.7 

White 6 4.8 0.4 -0.1 

No 76 4.9 0.4 0.2 
Economically disadvantaged 

Yes 1,181 4.6 0.9 -0.1 

No 1,242 4.6 0.9 -0.1 
Special Education eligible 

Yes 15 4.6 0.6 0.1 

No 184 4.3 1.1 -0.4 
Limited English Proficient (LEP) 

Yes 1,073 4.6 0.8 -0.1 

No 41 45 0.9 -0.3 
At risk 

Yes 1,216 4.6 0.9 -0.1 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 


Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut 


points are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 


Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 


HISD Research and Accountability 


43 


Table 2. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Number Naming Spanish Language Subtest Based on 


Prekindergarten Program and Demographic Group, 2016-2017 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 


Early Childhood Center 


School-based Program 


n Mean SD Mean difference 

1,192 4.1 1.2 0.1 
3.5-4.0 yrs 203 3.1 1.3 0.0 
4.0+ 989 4.3 1.0 0.2 
Female 621 4.0 1.2 0.0 
Male 571 4.1 1.1 0.1 
Asian - - - * 
Black 15 3.7 1.5 0.1 
Hispanic 1,166 4.0 1.2 0.0 
Other 5 4.4 0.9 0.3 
White 6 3.8 al} -0.1 
No 74 4.3 131 0.2 
Yes 1,118 4.0 1.2 0.0 
No 1,179 4.1 1.2 0.1 
Yes ils} 3.9 iL 2 Ont 
No 159 3.8 1.3 0.1 
Yes 1,033 4.1 1.1 0.1 
No 37 4.0 1.1 158 -0.1 
Yes 1,155 4.1 1.2 4,133 0.1 


are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 3. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Operations Spanish Language Subtest Based on Prekindergarten 


Program and Demographic Group, 2016-2017 


Early Childhood Center School-based Program 


Demographic characteristics n Mean SD 


Mean difference 


Overall Sample 0.0 

3.5-4.0 yrs -0.1 
Age Group 

4.0+ 0.1 

Female 0.0 
Gender 

Male 0.0 

Asian * 

Black -0.1 
Ethnicity Hispanic 0.0 

Other * 

White -0.3 

No 0.0 
Economically disadvantaged 

Yes 0.0 

No 0.0 
Special Education eligible 

Yes -0.1 

No -0.2 
Limited English Proficient (LEP) 

Yes 0.0 

No -0.4 
At risk 

Yes 0.0 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 


Note: Insofar as a score of three (3) is both the proficiency benchmark and the maximum score for this subtest, total means for all groups but those with uniformly perfect scores will fall below 


it. 
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Table 4. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Patterns Spanish Language Subtest Based on Prekindergarten 
Program and Demographic Group, 2016-2017 


Demographic characteristics 


Overall Sample 


Age Group 


Gender 


Ethnicity 


Economically disadvantaged 


Special Education eligible 


Limited English Proficient (LEP) 


At risk 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 


Early Childhood Center 


School-based Program 


n Mean SD Mean difference 

1,246 3.3 0.9 -0.1 
3.5-4.0 yrs 241 2.7 1.1 0.0 
4.0+ 1,005 3.5 0.8 0.0 
Female 653 3.3 0.9 -0.2 
Male 593 3.4 0.9 0.0 
Asian - - - a 
Black -0.7 
Hispanic 1,220 83} cea -0.1 
Other 5 3.2 1.3 -0.5 
White 6 3.0 0.6 -0.5 
No OL 3.7 0.6 0.2 
Yes 1,169 3.3 0.9 -0.1 
No 1,232 3.3 0.9 -0.1 
Yes 14 3.1 dal -0.2 
No -0.5 
Yes 1,063 3.4 0.9 0.0 
No -0.7 
Yes 1,205 3.4 0.9 0.0 


Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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Table 5. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Rote Counting Spanish Language Subtest Based on 
Prekindergarten Program and Demographic Group, 2016-2017 


Early Childhood Center School-based Program 

Demographic characteristics n Mean SD Son Mean 80 | Mean difference pile 
Overall Sample 0.0 0.00 

3.5-4.0 yrs 0.0 0.00 
Age Group 

4.0+ 0.0 0.00 

Female -0.1 -0.25* 
Gender 

Male 0.0 0.00 

Asian 0.0 z 

Black 0.0 0.00 
Ethnicity Hispanic 0.0 0.00 

Other -0.2 -0.43* 

White -0.1 -0.24* 

No 0.1 0.26* 
Economically disadvantaged 

Yes 0.0 0.00 

No 0.0 0.00 
Special Education eligible 

Yes 0.1 0.20* 

No -0.2 -0.47* 
Limited English Proficient (LEP) 

Yes 0.0 0.00 

No -0.1 -0.24* 
At risk 

Yes 0.0 0.00 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 
Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
Note: Insofar as a score of two (2) is both the proficiency benchmark and the maximum score for this subtest, total means for all groups but those with uniformly perfect scores will fall below it. 
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Table 6. Academic Achievement of HISD Prekindergarten Students on the End-of-Year HISD CIRCLE Shape Naming Spanish Language Subtest Based on 
Prekindergarten Program and Demographic Group, 2016-2017 


Early Childhood Center School-based Program 


Demographic characteristics n Mean SD Mean difference pis 
Overall Sample 1,265 4.5 0.9 0.1 0.10 

3.5-4.0 yrs 261 Sh) 1.2 0.0 0.00 
Age Group 

4.0+ 1,004 4.6 0.7 0.2 0.23* 

Female 664 4.5 0.9 0.1 0.10 
Gender 

Male 601 45 0.9 0.1 0.10 

Asian - - - e * 

Black 15 4.3 1.3 0.0 0.00 
Ethnicity Hispanic 1,239 4.5 0.9 0.1 0.10 

Other 5 4.8 0.5 0.1 0.15 

White 6 4.3 1.6 -0.1 -0.09 

No 77 4.6 0.9 0.2 0.20* 
Economically disadvantaged 

Yes 1,188 4.5 0.9 0.1 0.10 

No 1,250 45 0.9 0.1 0.10 
Special Education eligible 

Yes 15 4.5 1.0 0.5 0.42* 

No 185 4.3 1:2 0.0 0.00 
Limited English Proficient (LEP) 

Yes 1,080 4.5 0.9 0.1 0.10 

No 40 4.3 1.2 -0.2 -0.21* 
At risk 

Yes 1,225 4.5 0.9 0.1 0.10 


Source: HISD CIRCLE 2015-2016 student database; PEIMS 2015-2016 HISD student database. 

Note: Effect size measures which meet or exceed the Hedges g cutoff of 22 are italicized and marked with an asterisk. Students who scored on average below cut points 
are highlighted in gold, with the exception of students in the 3.5-4.0 year old age group as proficiency benchmarks are adjusted down for younger children. 
Caution should be used when interpreting effect size measures for populations with sample sizes below n = 30. 
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